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ABSTRACT ' . / 

To examine Philadelphia's 1977 school budget crisis, 
a chronology of events — from receipt of the proposed budget to final 
court approval — is listed. Many parties ue re involved uithin the 
school district and in the conaunity^ Frequently, cne cr icre parties/ 
blaaed other parties for creating the prcblen. Directors of each of; 
the five service components in Philadelphia's Office of Research and 
Evaluation prepared statements detailing the impact of budget 
restrict ions, particularly staff layoff, cn thpir respective 
divisions. The five components are: administrative 'and survey 
research, testing, federal evaluation, priori^ operations, and 
instructional research and development. Diredinr^ reported that the 
main effects of the budget crisis were Idv morale, unfulfilled 
potential, and interruption of prograt evaluations and report 
production. Recognizing that the budget crisis is a pereccial/ 
problem, the Small Project Assessment Service vas initiated to 
provide directors of projects vith limited funds and with technical 
expertise from the Office of Research and Evaluaticn** While the 
Service needs some revision, the concept is a good one --especially in 
financially troubled tines. (CP) 
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" The Effects of .Budget Reductions on Program Evaluation 

# in; a Large Urtan Sc.hooJL System:, Providing 
• . . • Services Beyond Resources " ' 

• ' 4,'/' ■ ' ' ' ^ r . ■ ' . ^ \ \ , J''" 

I. BtJDpETS; EVALUATION SERVICE:S, AND THE SCHOOL DISTillCT 05 PHILAHELPHIA r ■• 
' AN-bVERVl^wr ' ' -r . ■ '■ "'^'^ ' 

prffe of ^the^most. critical variables affecting the (fuallty of schooling 
is mbnqy^? how tt is collfected,[how it Is spent," Who spends it,^and the^oods 
*and services it buys. As of July^l, 1977,, the School District of j^Philadelphla 
was $173 million short of „its ^uliSposed $^84 million budget fox the 1977-1978 v 
..school year.' From March, 1977 (when the feard^of Education ^rec6lved th^e pro- 
posed budget) until j4ovemberi 1977 (when alCommon Pleas Court; judge^ granted 
final approval of a $50 million long^ttetm loa^n) apd, beyond, the School nl s- 
trict's financial prorblems wertre ,page ime news/ Quite naturajtly, the Office 
of Research and Evaluation wlls^notyiinaffected Ij^y all , of this, ^: 



this paper will examine 'thi^ $^hboX pis ttlct *s lJudget' crisis from- three 
perspectives. First, the various "facitors contributing to the problem systeta 
wide will be examined, including^^'a cftrarjology of events^ Jeadin^ to its resolu- 
tion (at l«re^t for this current year), ^ . , / 

Second, ttia impact of budget problems on thfe Office of Research; and 
Evaluation In particular Will be described. Third, the Small Pfbjefct As$ess- 
ment Service, a procedure for the Office of Researcrfi and Evaluation (ORE) to 



provide program evaluation service beyond ^ts existiiig personrtiel f^soirces 



will be discussed; The d^grjSie t;a which this service iA curj^ntly utilized,- 
as well as the potential for its future use are included, ' ? 



II. FINDING TH^ONEY TO BALAlfCE THE BUDGET: THE STORY OF A. $173 MILLION 
DEFICIT-. *^ - ' 

November, 1^, 1977. The crisis, at least for the 1977-1978 school 



year, was finally over. Neatly eight months after the Philfadelphia Board- 
of Education received a $684 million proposed budget with a proj.ected def- 
icit of $173 million, a Court of Common Pleas ju^e granted fin^ approva^^^ 
of a $50^hiillion long' term loan. The ScI>oo;L District budget was balanced . ^ 
at $635 million;;. $49 milxion less than originaily* proposed ; 

y , ; . ; .' 

The series of events which ^occurred fronf March through N'ovember was in- 
volved as any television melodrama, a'nd featured a cast of thousands. Players 
included the Superintendent of Schools, the Board 'of Education, 30,000 em- , , 

' • " ■■■ ■ - . • \ 

ployees (10,000 of whom we^e laid off for the summer; 2,000 permanently), 
teacher, administrator and maintenance unions, the Pennsylvania State 
Legislature, the Mayor, €ity Council, the Philadelphiat banking eommunity, . 
255,000 school children and their parents, the. Citizens Committee on Public 
Education in Philadelphia, the Siijjreme Court of ^Pennsylvania , and a Philadel- 
phia Court of Common Pleas judge. - J' 

, ^ ; . ^ ; ^' , . ^ / 

While there was a defini^ lack of money for the schools throughout tjie 
summer of 1977, there were no lapk of solutions toyresolve the crisis. These 
solutions, for the most part^, involved one or more* "p.layers" beaming other 
/^layers" for creation of^^e problem. ^ Each suggested spluti^n fof the bud- 
get deficit invariably c e^^enae of those "Slayei^ w^o were blamed. 
There was fio shortage of( ffhger pQlntingJ Depending on wtto Was pointing; 

\L " • ' ' ■ 'I- ' ' \ ' ' 

everyane*-^t one time or another yaps, responsible. j . 

•jHPie jnaybr blamed the Citizeti^ 'Committee on Publ^ Education in PhiJ^del-' 
^hia (QCPEP) for legal action that questioned, loans neceskary tb .b^lattc^ the 
budget. CCPEP blamed tlie Mayor, Bpard off Education, City/ Council ^ unions 



^nd 



the State Le: 



gislkture fojr failuiWSo jointly sjiare responsibility for 



quality educat 



Paiaenfcs blamed the Boa^ of Education for irresiponsible 'spending, es- 
pecially on union contracts and "frills" (chauffeur "driven^ars for Board' 
members). . The Board of Education blamed pressing demands from unions and 

V^creased costs of utilities and supplies. Tax revenues collected by the' 
cit^ for School District use wer^ ^lot keeping pace with, the rate of inflation. 
In spite of a record tax increase the previous year, the schools were y/ot 

•receiving a fair share. For these things , the Board blamed City Council. 

) ■ '^^ ■. ..' 

City Council blamed the Boprd for lack of fiscal responsibility. Giving 

• ^ ■ . / ' ' 

more money to the schools, they said, would cut too diSply into other nec- 

essary city services. The Board cit^ the Educational- Home. Rule Charter as 

its .defense. The charter provides .for a Mayor-appointed ^chool Board pi^- 

hibited from levying taxes ^ yet empowered to negotiat^e contracts with teach- 

ers', administrators' atCd ma:^ntenence workers* bargaining unlt^ for raised 

and benefits. ^ " 



The unions, most notably the Philadelphia Federation of Teachers (PFT) , 



blamed the Mayor, City Council., the Board arf^C-ihe State. Jo account fot the 




, nearly 10,000 ^choo^! 



majority of ^e $173 million, nearly 10,000 School* District em^lbyees wefe' 
laid, off ^ or terminated. PFT leaders refused to give up any previously nego- 
tlated contract item, such a's ^increasing class size from 33to35^ even if such 
a move would^eventually result in bringing more of its membership back to 
work. Lay^-offs would cost theiunion, thousands of dollars In dues; one per 
c^nt o^ each memberVs salary ^oes to the union. 

. ^ " ■ • .'{ - ■ ^ . : ' 

^ Virtually everyone ift Philatielphx^^^J^ed the State Legislature; a rural/' 

suburban dominated body,' split by its own special interest groups yet united *■ 



in. its anti-Phil^lphia feeling. Tbe Legislature was utllble to settle 
on a new State budget and unwilling to agree W a subsidyy formula to assiat 
in funding any of its ^504 School Districts. TWb Legislature blamed the city 
government ^or not doing enough tki its own to^ helV-tlje^scliools . They were / 
anxious for the city lo abolish its appointed school board In favor of an 
elected body which could raise taxes as needed. The Legislature was quick 
to cite the fact that Philadellihia was the only school district in the state 
not to ftave an elected. board. . ^ 

. Then, there was Phil^elphia' s banking comraunity, A cone^xitium of local 

banks and lending, institutions led by one powerful banker regularly \ent the 

school Board money to pperate the system. * A jkey/element in the budget crisis \ 

s£ttlemen| was^a $50 nilllion long-term/ bank loan. When a Common Pleas Court 

judge riJli^the loan violated a state' law (an^ was upheld by the jState Supn 

Court) the budget was no longer in balance. Without a balanced budget, the 

banks refused to provide another type of lo^ the ^schopls needed — shor:t- 

^rm loans to ease nomal casf)-f low. problems ^nyii^ the^ system revenues 

• A' ' - 

froii^ state and local sources became available! 

• ~ V 

The law was amended and -the $^ milUon loan approved, but^ until ' that 
was. accomplished, the b.^nkers canje under heavy .dfitftism for ^ailuVe to 

Supply the guaranteed shbr^t-ternK^ans . The Schopl District missed its • 

- ^' - ■ ' ' x-^ ' } \ 

payroll by a full week, and parents gllQups threatened tfe close Accounts in banks 

. , ^ ; . ; ^ ' ^ , /. ^» ( . • 4 

refusing to provide the short-term loans. • . r ' 

; • . - , ^ 

. The special $50 million loan was aego|iat^d oil the condition t^et the 
school, budget could increase n6 more than "^^^ per yfe^r fbr the t^t five ye^r^ / 

.. •' ''^ ' ' ■•«'' ^ * 




[|he tertir ox tne loanj. xne nead-ot the* conspi 
as a lever ;^ no balanced budget,- no shortr-term loans; The School District, 



(the ter# of the loan). The head- of the* consortium used short-term loans 



^in desperate neecj of? the money to save jobs arui prograiKs, accepted the con- 
ditions. ,T6 3ome, the bankers had fih^lly feak^n a fitjJivS^ep In the dire^- 



mkers had fih^lly feald|n ^ fitTfivStep In t 
il responsibility )^o]^ fh^fefchools. To ot 



tion of much needed fiscal responsibility )^o]^ fhe?, fefchools. To others, .the 
bankers had managed vtoimake a healt^^al^f percent iriterest ($12.5 million 
(j^ the $50 million lon^-term loap)^P^ the ' expense of School District pro- 
grams and personnel. 




Finally, thereVwete 55,000 students. While blameless, the bud- 

gj(&t crisis and its resultiM^^jfedu^ the most. 



So much for the cast ,1^;^J34yers i^the School District of Philadelphia 
"Budget Crisis"* of 1977-1978. . Unfortunately, the performance seems set for 
a long run. The M7^1979 editioirrte^^fiuirentlxln production. 

' . f \ ■ ■ ■:' 

^ chronology of events for 1977-1978 follows: 

"4 

t * V 

Marclji 25, 19sZ7 - The Philadelphia Board of Education receives < \ 

its 1977-1978 proposed budget calling for 
^ $684 million. The barAing commonity insists ^ 

that the budget be balanced prior to its 
formal adoption, ,in orrder for the^School 
District to qualify for short-term :bank 
loans to complere the 1976-1977 school year. 

C ■ : f -• V 

May 31, 1977 - The Board approves a balanced budget. Since 
^ the Pennsylvania State Legislature has not 
. agreed on t^e 1977-1978 State budget, the 
v^^'. School DiiBtric|: is unable to include any 
State funa^ over those received for 1976- 
* ^ 1977. As S result, $173 mi^^llion reductions/ 

in personnel and programs are announced. 
' Cuts include all, services not mandated by 

^ J , State. Kindergarten Is eliminated; 

^ ^' >^ school libraries closed; varsity spoifts, 

abolished; 32 schools shut; counseling 
^ . servicesVcurtailed. , In addition, food 



services, health services/enrichment programs, 
art, music, r driver education, foreign languages, 
alternative programs, transportation services, 
security, building maintenance and operations, 
business operations, and data processing at*e 
all severely cut, Ijn all, close to 10,000 
School DistrLct employees are slated to be 
laid off, 



Jun'e 30, 1977 - As required by union contracts jy-lay-off letters* 

are , distributed to 10,000 worj^^rs, including 
nearly 2,500 teachers, 2,000 custodians, 1,400 
noon-time aides, 1,200 cafeteria workers, 800 
classroom aides, 700 .nori-teaching assistants, 
400 secretaries, 300 bus drivers, 350 administra- 
tors, and 26 staff members of the Office of 
Research and Evaluation, 



July 1, 1977 - There is no State budget, Th^re are no new 

State monies for the schools, L^y-offs are in 
effect. Twelve month* employees are immediately 
affected. Ten month employees are ruled eligible 
> to collect unemployment .compensation. Newspapers 

are quick to cite how mdch money these employees 
^ are likely to make over the summer until they are 
recalled to work; "Lay-off Notices Made School 
Workers Richer," headlines proclaim. 



August 2, 1977 - State Legislators are still trying to agree on 

budget that requires no increase in taxes 
while fully funding all government services 
wand giving additional aid to the public schbols. 
They are not successful. Regardless of how they, 
try, this august body is always $300 million 
short, ^ 

At the School District's personnel office, 
there is "extreme uncertainty as to what will 
happen in September." School officials are 
attempting^ to assign employees to jobs and 
buildings. Depending on the Legislature, some 
may be hired back, some not. Row jnany or which 
ones are still in question. Teachers who were 
not laid off, but who^e particular programs 
were cut back or eliminated, are particularly 
uncertain. An experienced kindergarten' teacher, 
for . example, must now be reassigned to another 
grade. Since the Sishool District has been hold- 
itig off on reassignments pending action from the 
Legislature, t\\e teacher is left waiting, 

8lJ 



1 "«\ I ^ 



August 20. 1977 - A new, State budget is finally adopted, ^ There 

will be no new taxes. Instead, aid to the . ^ 
state.colleges and universities is postponed. 
E€timat^d cost for- the college aid is figured 
to b^ $300 million.'. Somewhere, there is logic 
in all of this*. 

* . 

Money from the State to the School District 
amounts to $50 mill^.on. Gity Council pledges 
$10 million. The Mayor shifts $14 million in 
* ^ welfare court funds to the schools. The deficit ' 

is reduced to $99 million^: The Superintendent . 
feels schools may yet open on time. 

August 23, 1977 - . The leader of the Philadelphia banking consortium 
^ - and the Ixjard meet to discuss terms of a $50 million 

•loan which would^ reduce the defj^cit to $49 million,, 
giving' the School District a total of $124 million. 

The president ^of PhiladelpHla fjfederation of 
Teachers refuses to waive any portions of*. its con- 
tract in* order to save money for the schools. 

August 24, 1977 - Banks promise to/ lend the School District the $50 

million. The miney does not come without strings. 
Along with the [eight percent int^erest, the Board 
is expected to Rpld the growtb of its expenditures 

j to no more than ^ven percent per pupil annually' 

over the five year term of the loan. The Board*s 
budget has grown ^between 12 and 18 percent annually 
sinc^ 1967-1968. . ^ 

The board is split over the loan question. a 
- "It's Scarlet. O'Hara economics," says pne Board 

member. "We 'IT worry (about the consequences of 
' ^ the loan) tomorrow. " One Board member opposes 

the loan on the basis of the banks' stricf con- 
ditions. Another Board member is^i^^ favor of 
^ . operating without the $50 million. "It only 

digs us deeper into debt.., I think we ought to 
bite the bullet." 

* Editorials in all three daily papers caution' 

against the loan. CCPEP threaten^s suit if the 
loan is accepted. 



/ 
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August 25, 1977 - The school Board meets to begin deliberations, 

on whigh Jobs, programs and services wilJL be 
restored. ^ * , 



August- 27, * 1977 - ^ The Mayor announces that the city would provide 

an additional $120 in^|J.lion to the School District, 
Starting, with the 1978-1979 school year, the city 
would contribute $20 million in both 1978-1979 
and 1979-1980, and $40 million in the 1980-1981 
and 1981-19^2 school years. * Critics say that the/ 
proposal makes no new money available now, and 
leavQs the next J^yor to pay for the current 
Mayor's pledges. 

August 31, 1977 - The Board of Education ends the summer- long 

f inariTcial crisis by voting 5-3 to accept the 
$50 mil-lion loan. Notices of recall are mailed 
to three-fourths of the 10,000 workers who were 
laid off in June. Restored fully are kinder-^ 
garten, sports, skills centers, foodi health 
and dental services and enrichment programs. 
Partially restored are art, mUsic, counseling, 
transportation , security, driver education, 
alternative programs, and chauffeurs for 
Board members and top administrators. Earlier 
^ reductions in administratioti, other educational 

programs and maintenance workers, are not re- 
\ cinded. 



September 9, 1977 - Schools open for the 1977-1978 academic year. 
» 

Septeiwber 12, 1977 Bus drivers, custodians and maintenance workers 
, ^ for the School District strike in. an effort to 

keep the Board from "stripping" the* maintenance 
union's contract of benefits , ^The Board seeks' a 
two year contract with no wage increases and re- 
fuses to restore any of the i,373 union members 
laid off in June as long as there is'no contract. 
A6 a result, the School District has only 50 bus- 
. drivers to operate 262 buses. In spite of no 
lunch and transportation service, schools re- 
main open. 

The presidetit of the PFT instructs teachers 
to i>eport for work as usual, but to do no main- 
tenance tasks. Teachers are directed not to work 
once buildj^ng conditions began to deteriorate. " 
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September 15, 1977 - 



Although strongly In jf^vor of solidarity, 
leaders of the Philadelphia Federation of 
Teachei^s (PFT) vote to allow the union's 
22^000 members to decide at a mass meeting 
whether to cross picked lines pf bus and 
maintenance workers. Should teachers elect 
not "to cross the lines, the effect on the 
school system would be crippling. 



September 20, 1977 - 



Rejecting the recoiranendatiori of its leader- 
ship the PFT v6tes overwhelmingly to continue 
to cross picket lines of striking bus and main- 
tenance workers. Only 200 of the 12,000 union 
members are in fayor of honoring the lines. 
Maintenance workers fcrossed teachers ' lines^ 
during an 11 week strike in 1972-1973. With 
its own contract due to expire in September, 
1978, the PFT chief negotiator coTnmen ted that 
the teachers voted *'to go it alone next Sept- 
ember.*' 



September 28, 1977 - 



Negotiators for the School District and striking 
maintenance workers and bus drivers reach a tent- 
ative agreement. 



October 6, 1977 



By a vote of 1,269 - 1,109 maintenance workers 
and bus drivers reject the tentative September 
28th settlement. 



October 13, 1977 



Steadily mounting heating problems and the ab- 
sence of striking maintenance workers force 
the closing of 55 schools. 



October 18, 1977 



Negoti'ators for the School District and striking 
maintenance workers and bus drivers reach a sec- 
ond^ tentative agreement. 



October 20, 1977 



After hearing the latest offer, at a mass meeting 
Maintenance. workers vote by mail to finally end 
the five week strike. The four year contract 
calls for no wage increase the first year, in- 
creases equal to whatever the teachers get for 
the second year ( a gamble which coi/ld see the 
workers getting nothing the second y6ar also). 
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and ^'one^shot*' cost of living bonuses for the 
third and fourth years. In addition, the Board 
. agrees to increase its contribution to the workers 
health and welfare fund from 6Q percent to 100 
percent by the fourth year. » 
'\t ■ ■ _ . 

October 20, 1977 - 'A Common Pleas Court judge declares the $30 m.illion 

loan from the banks to the Sdiool District illegal, 
renewing the financial crisis. The ruling is un- 
expected by the School District, They immediately 
appeal to the State Supreme Court, 

The rulfng forjces the Board to re-balance thi| 
7 budget or find' $50 million more in revenues. A ' 

State iaw requires school districts to obtain court 
' * permission to f-inance unfunde;d debt. To do this, -^he 

district must prove four things: that the deficit 
had been incurred legally; that without the loan, 
serious harm would be dpne to the city; that it 
was impos^sible to increase taxes to' eliminate the 
deficit; and that the deficit had been unforseeable- 
The judge ruled the deficit .was foreseen, 

^ ' ' Without the $50' million loan, the budget Is no 

longer balanced, and sbhools may be closed, within 
two weeks. '*^ithout a balanced budget, the bajikers 
may not provide the annual short-term loan to meet 
payrolls at the end of October. — 

October 25, 1977 - The Governor' advances $20 million in subsidie^to 
^ the School District to enable the system to re-) 

main open beyond Friday, October 28, ^e city 
agrees to advance $10 million- The Board votes 
to delay payment on debts falling due now (in- 
cluding $11 million for the School employees 
retirement fund) in order to meet the Friday 
payroll. Union leaders and parents threaten to 
^ withdraw funds from any banks refir^ip^ to supply 

^ the guaranteed short term loans. ^ 

October 26, 1977 -iBy a 4-3 vote,. the State Supreme Court upholds 

the lower court ruling, refusing to allow the 
$50 million loan. The budget remains unbalanced, 
' , • and bankers reiterate that they will make no 

short term loans without a balanced budget. 
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^ October 27, 1977 - 



November 1977 - 

> 

November 10, 1977 - 



rJovember 16, 1977 - 



I^oyember 18, 1977 - 



The Bo^rd yotes to keep the schools open for 
^t least two more weeks while the State Legislature 
tries to resolve the system's financial crisis. A 
bill under consideration would exempt the School 
District for one year from the law thfe Common 
Pleas Court judge ruled it had violated. 

Teacher^ a^miqistrator and maintenance unions 
agree t6 continue working without guaranteev^of re- 
ceiving their November 11 pay. 



The State Legislature gives final approval to 
legislation that will enable the School District 
to borrow $50 milli^, thereby rebalancing, the bu^ 
get and keeping schools open. ' 



The same Court of Common Pleas judge who originally 
ruled the ,$5(^ million loan illegal, "reluctantly" 
approves the- loan following action by the State 
Legislature. The approval is conditional, pending 
approval of the final terms of the loan. 



With "great trepidation" the Common Pleas' Court 
judge grants finkl approval of the loan, finally 
ending the budgec crisis for 1977-1978. The loan 
set for 5 years at ,8 percent each year, will actu- 
ally cost taxpayers $12.5 million in interest. 

Short term loans to meet payrolls and bills 
are immediately negotiated. 



School District employees receive checks due them 
November 11, 1977. The judge warns the school 
board that the next two years are "frought with 
economic danger. " 
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III. THE OFFICE OF RESEARCH AND EVALUATION^ BUDGET REDUCTIONS .STRikE HOME 

A. The Office of Research and Evaluation Described 

--^^^ The Office of Research and Evaluation (ORE) of the School Dis- 
trict of Philadelphia serves teachers and administrators by providing 
evaluations of instructional programs, ^creating innovative measure- 
ment instruments, and communicating government-required, information. \ 

> All functions of the Office of Research and Evaluation are co- 

ordinated in the executive director/ s office. As chief administrator, 
the executive director is responsible for planning, establishing 
policy, and monitoring ORE*s five service components. 

1. ADMINISTRATIVE AND SURVEY RESEARCH SERVICES: develdps and 

supplies required School District data to government agencies, 
school administrators, and other decision makers. One of its 
major projects is a computerized directory fifle of current and 



historical information about the more than 2^5, boo Philadelphia 
public school children. The division conduct^'' follow-up surveys 
of former School District students and demographic and socio- 
economic analyses of the present school population, and maintains 
the Superintendent's Management Information Center, a collection 

"V 

of pertinent information about each school in the system. 



2. TESTING SERVICES: plans and administers the citywide standard- 
ized testing program. It organizes staff -development sessions 
and prepares test-administration manuals to inform teachers, 
counselors, and principals about the examinations. The division 
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alsp interpr^^'s and distributes test results, school summary 
Droriies. individual pupil-performance analyses. 



FE^.RAL EVALUATION RESOURCE SERVICES: personnel visit, evaluate 
and report on Title I and other federally-funded programs for 
local, state, and national government agencies, Evaluators con- 
duct extensive observations, help develop and implement assess- 
ment methods, and write reports which share results and recommend- 
ations vith administrators. Department personnel also consult 
with project directors, to aid them in formulating objectives 
and assessing attainment, 

PRIORITY OPERATIONS EVALUATION SERVICES: assesses high-priority 
educational programs at city and district levels, Evaluators 
look across district and project lines to discover and report 
successful instructional practices, which might benefit all pupils 
if more widely adopted. Department personnel evaluate early child- 
hood education, alternative programs , ^special education, career 
.^education, and basic skills projects. Other staff members are 
assigned to the eight districts to serve the district superin- 
tendents, ^ 

INSTRUCTIONAL RESEARCH AND DEVELOP>fENT SERVICES; assists the 
other divisions and departments . of <)RE . It selects and creates 

j 

instruments for measuring pupil ne^ds and educational progress. 
Systems for performing statistical analyses, utilizing data files, 
and scoring and compiling citywide test results nre developed 
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and applied in cooperation with "SchoalD^gg^rict data-processing 

*prof ess^nals. Staff members also edit 'and prepare ORE |j>roject 

y ■ r 

evaluations and other legally-required documents for publication, 

The Effects of Tludget Reductions on ORE /J' . 

/■ 

/ ^ ... ^ 

Teachers and principals were not affected itranetiiately by the 



2d itranetiif 
illy wor^ 



these employees normally do not work during Ju^y aatl August, 



budget reductions. Such employees, who normally worf. the ten month 
school year, suffered anxiety and uncertainty about the fall, but 

r 

Twelve month emf^P^ees who were laid off knew the effects of 
the budgfet crisis right away. On Thursday, June 30, they came to 
work. Op Friday, July 1, they did not. 

When various suggestions were offered as to which programs and 
services the board could best do without, "Research and Evaluation 
was rarely mentioned. In fact, the head of the Citizens Committee 
on Public Education in Philadelphia called for an increase In the . 
size of ORE. She cited the need for such service as being especially 
important in times when cuts had to be made. VTho, she asked, could 
better judge the effectiveness of school district programs than its 
Office of Research and Evaluation? 

In spite of the recognize*^ need for evaluation '^service, among 
those not returning to work on July 1 were 26 (of 93) ORE staff 
members. Budget cuts forced the offic^ to lay-off nearly a quarter 
of its total pro!§|issional staff and over one-half of its operating 



budget personnel. The remaining sfaff was left to provide service 
beyond existing resources. 



^ Directors of each of the five service components prepared stat6-^ 
ments detailing the impact of the budget reductions on their respective 
divisions if nothing were restored. 

Administrative and Survey Research Services (ASRS) reported that it 
would expect: ; ^ 

1. Elimination of the ten-year enrollment sutnmary report. 

2. Delays in the pupil directory (1 month) - major impact. 

3. Delays in all sul*vey research (T month) n 
Short range enrollment projection. , / ' , 

4. Delays in the Superintendent's Management Information Center 
materials -(2 months) . , ' 

5. -Addition by 50% in time of ad hoc service responses to schools. 

Division of Testing Services (DOTS) reported that it would expect : 

1. Reduction by 2/3 of secretarial/clerical support. 
(Could continue the testing program, but with timeline 

extended by several months) 

2. 50% reduction in services to schools^ 

Federal Evaluation Resource Services (FERS) reported that their work 
could be completed, but with delays. Since this division is federally 
funded, the budget crisis impacted on it the least. 

Priority Operations Evaluation Servicjgs (POES) reported that it would 
expect: ^ 

1. A 25% reduction in district field services . 

*N 
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2. Elimination of ail Alternative -Programs evaluation and 
"Checkpoint evaluation. ; 



) 3. Delays in the Hahnemann Hospital cooperative program. 

(■ ^ ■ ^ ^" • 

A. Elimination of the Early Childhood Evaluation Unit. and 
-and Early ' Childhood Pupil Directory File. 

^ 5. Sharp curtailment in dlrect^services to s^chools . 

6. Reducti^on of services to the reading program. 

Division of Instructional Research and Development ' Services (DIRDS) 
reported that it would expe^: " ' ^ ^ 

1. ' Fuhctiona'l Literacy Assessment ' 

Reading, 12th grade -7 delayed. 
^ ^ * llth grade - severe delays 

^ Math - postponed one year ' ^, . < . 

s y . ' . 

2. Increase in response time for analysis requests, inr-house 
scoring services;^ and other in-house requests which would 
further delay work to bfe completed by other ORE divisions. ^ 

■ 1 ■ ' ^' ^' . 

t 

\ ^ 

In a report to the Superintendent and the Board of Education, the Execu 

tive Director of ORE examined the division reports to produce a list of prod 

f • - 

ucts ^and services which would either reduced, dimini slri'ed or eliminated a 
a result of permanent reductions: 




1. Documentation of the impact of the Early Childhood Program, 

2. Meeting Federal and State mandates on time 

a. Identify Title J eligible schools 

b. Create lists of Title I eligible pupils 

c. Title I Needs Assessments *^^\/^ 

d. ESOL file 
^ e. Title I'^Evaluation Summaries, 

f. Title I ^pplicart-j on ^ 
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4. 



Dlrdct services to ^Qhools iji all research and ' eyaluati^on ^nd 
testing areas 

Feedback to prcSjeot personnel, staff, atld]ti 



5. Pupil Pirectory j:ifv&onnatlon Pile (PDIF) 

' * ' s 

a. PRtP timelines cannot b^met 
• b. Federal and State reporting requirement^ - late 
c. Title I eligib:|(e schools 

Inability, to pre-slug will ^eopardiz-e abili^t;y to score test 



in-house . 

6, PI^IF severely . limited in direct service to schools 

a. Rollbook Jeaves " • 

b. Transportation planning and busing ' ■% 

c. Ad hoc reports (attendance areas, labels) 

7, PDIF cutback- would result in interruption iri the continuity of 
other files and would Jebp^ardize data in all f^l^^ 

8. Ability to deal with new Fe^ral reporting system (RMC) - Title I 

9. Ability to fnaintain files and report results for the ^Functional 
Literacy Assessment program ' V > 

10. Ability to provide test results in same year, which means test 
results cannot b^ used fotr organizational purposed 

' . ■ ■ ' ' ■ ' - • >■ - 

11. Ability to develop proposals to generate , additional fun^s' for 
School District 

12. Elimination of all outside cooperative research 



13, Use and interpretation of test data in schooJs 



12f, Ability to service 'the following top system priorities: 
Alternative Programs 
./Checkpoint Program 
Evaluation of service to Speakers of Other Languages 
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• Kinder^ariien 



Language Skills 
Pare'nt Nurseries 
Parkway Program 
Franklin Learning Center 
Pre-school ' rro 
Randolph Sk^lls^^Cl 
Reading Program y\'V^C']^^^^^ 
Swenson Skiljs Center 




Walnut Center 



As programs wejre restored, so £00 were 'pfosrl'tlons budgeted for evaluation 
of ciiGse programs. By September, mos^ of the ORE professional staff had re- 
turned. Of th^ eight reseprch associates, three research assistants and ^ur 

. ■ ■ : •.'■■■<*'.'.■ " ' k • ; . ^ ■ 

research iViterns, who >7.ere originally cut, all but one research aissociate re-' 

turned' to the office. No directprsv assistant directors or managers received 
notice of ^ay-off . • . 



In spite of the lis^ of products and Svervices which would have been re- ^ 
duced, diminished or eliminated as result of the reductions, the main ^f fectfe 
of thf* budget crfsig on GR]^ caye'^^ni^heytorm of low morale, a sense of unful- 

f ill^d'potential, arid a ge]rieral!UTTteiti4upt:(^ of service. 

\\- - 

.-^ ■, ... ' ./ 

1 • Low Morale 



As in any biiireaXicBacy , t)he longer one Works in the system, the more 



' secure ^oneVg ^[^sitiop.' ' Suqih was the case in the School District. 
Since moat advancement gej\era;tly comes from within, and a teaching 
certificate is' the foundation upon which,, careers are'bullt, many 



administrator^ /found themselves back In the classroom Clf only f pr a short 

h 

time). In terms of.morale, this may have been a come down, but It was better 
,than unemployment compensatlor>. ^ ♦ 

; ■ • f 

The Office of Research and Evaluation Is relatively new In the school 
district. There had always been a Division of Research., hut not until the 
middle to late 1960's did the office as it is currently structured come to be. 
ORE staff cameto the office with two different professional orientations: 
former teachers or administrators with minimum requirements in research or 
evaluation graduate work, but with years in the system; and university trained 
specialists with direct related experience in research methodology, test de- 
velopment or evaluation, but With tro previous time in the system. The majority 
of the staff fell^gmto the latter category. Over time, the distinction be- * 
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tween these two t^^B of professional staff disappeared. New employees in 
the offlce^^me, for the most part, with the second orientation. As the field 
of research and evaluation grew nationally, so too did the status of ORE and 
the professional background of new employees in the office. 

Once cuts were announced, Iwwever, the only thing that made a difference 
was permanent time in the system. Many of the "outside the system"' staff , 
while working in ORE since 1968 or 1969, were appointed to their positions 
through a testing procedure administrated by a previous executive director 
of the office. These employees were not officially tested through the office 
of personnel until June of 1973. As far as cuts were concerned, that was the 
date that counted. Several research associates, through no fault of their 
own, lost five years seniority. In at least one case, a research assistant 
whow'^aip officially tested through the personnel Jifcice, and subsequently 



appointed a research rssociate on a provisional basis in 1975, was placed 

*■ * i 

higher on the seniority list than a research associate who had been working 
provisionally in that capacity since the early I970's, One's firs^t permanent^ 
appointment date served to decide who stayed and who did not. Naturally, 
those staff members who carte to ORE from the classroom vere safe, S;everal 
had appointment dates in the mid 1950 's, when a behavioral objective was- 
nothing more than a gl^am in the eyes of Robert Mager, Few gave any thought then 
then tlK'U one day they would work in an office of research and evaluation. 

For those whc'were tested as a group in June, 1973, the examination score 
was used as fjnal arbiter. A score of 86 on an oral » examination kept on^em- 
ploypd; a score ot 85 led to the unemployment office. This created a severe 
•morale problem. * 

In the case of the research associates, there were 28 bodies to fill 20 
positions. Depending- on previous ptofess1*<D>nal/ experience (a prior school 
district position) and place on the seniority list, an equitable solution for 
one associate meant unemployment for another. That it fiuj^ly came down to 
a difference of one point on a test was particularly IrWTlc in an office that 
specializes in test development and statistical analysis, among other things. 
'Is there a standard error of measure on an oral examination? 

The morale ^pJoblem was fueled by sevejral grievances which were Initiated 
over list positions, as well as a suit filed in Federal Court by three female 
research associates. They claimed racial and sexual discrimination over their 
scores on the 1973 test which ultimately resulted in their lay-off four years 
later. The suit forced several research associates, who were not cut to retain 
legal counsel for their own pro.tection. 
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Even reinstatement. of seven of eight research rssociates as well as three 
research assistants and four research interns did not appreciably boost morale 
. in the office. School system morale as a whole, was at an all time low. The 
'general attitude 4.as one of "if it happened once, it can happen again." The 
fact that It came close to happening again only two months later did not ease 
those feelings to any great degree. 

\ ' ' ' 

\ 2. Unfulfilled Potential . ' ' 

Very much related to the low morale in the office came a sense ' 

of unfulfilled potential. ^lot only for the ORE staff, but for all School^ 

District employees. Traditionally working for a school system, if not well' 

paying, was secure. Only within the past three to five years has the situation 

^'eversed, due to increasing salaries and declining enrollments. Professional 

mee and women who spend thousands of dollars to complete their academic train- 
h . • * . ■ 

''k^ from their first graduate course through the doctoral dissertation may 

^/ind themselves at a {professional dead end. Regardless of how well they hay 
write, or*how much creativity and initiative they may display, there is precious 
^ little room for advancement. 



There are three main ways to advance to a higher position in ORE 
(o|,^he school system in general): someone resigns or retires; someone ties ' 
another -position out of the office or out of the system; or new positions are 
created. 

Within ORE, each manner, of advancement is limited. The office is 
yoVfng. No director, assistant director, manager or associate is close to re- 
tirement age. 
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/ " ^Porsonnel in supervisory positions (those previously mentioned) are 
paid quite well/ Staff who hold such positions, |;herefore, are not anxious 
to take other positions outside the office- Sujp^ervisory research, and evalua- 
tion staff in other cities are generally paid^ less then their Philadelphia 
counterparts. ' / " * 

Newly created positions are generally funded categorically. These 
new positions, however, have served mbre to^^keep the office from growing 
smaller than to provide the means for expansion. As operating budget slot^ 
aire lost and funding on categorically funded positions runs out, new positions 
are barely enough to retain the status quo. 

Since July 1, 1975, the number of research associatdSosi tions has . 
remaineci stable. One resigned, one left to take another position within t^e 
system, one was hired from outside the system (and terminated June 30, 1977y^, 
and two research assistants have been promoted to associate. A net change of 
no new associates; promotion from within of two research assistants. 

This lack of movement, coupled with the devastating morale problem 
taused by the cuts, created a sense of unfulfilled potential in many of the 
staff. This feeling (while hardly ORE specific) is less than comforting. 
Too many assistant professors of education waiting for tenure, too many 
college graduates looking for teaching positions, and too many teachers holding 
un-used principal certificates only share the feeling. It is something that 
those of us who chose education as a career have to live with just now. 



IX: 
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3, Interruption of Sqjjrvice ' . , 

The third main effject of the budget reductions on ORE came In the 
form of Interrupted service. There was a great loss of time. Summer is 
report writing season. The past year's reporj^s ^nd pragram evaluations 
are completed while objectives for the coming year's programs are dis- 
cqssed and formulated with project peir-sonnel. 

Report' production was interrupted for five main reasons;, first, a 
lack of typing service due to vacations and the lay-off of one-third of 
the secretarial staff; second, the. lay-off of staff members responsible 
for writing reports; thirds the necessity for staff members not familiar 
with projects to complete reports started by laid off staff members 
(these being over and above their own work load); fourth, the delay In 
analysis of data due to cuts in the Divisi^ of Da|:a Processing; fifth, 
lay-off, reorganization and reassignment of prgject personnel which de- 
layed formulation of 1977-1978 program objectives. 

Evaluations of the district reading programs serve as an example 
of interrupted report production. Each of the five main reasons can be 
cited to explain how the final evaluation reports for the 1976-1977 school 
year were not published and released until March of 1978. V 

Each of the school system's eight administrative districts annually 
^submits a comprehensive reading pl^|| to central administration. Four re- 
search associates were responsible fcfr evaluating the plans (each servicing 
two districts). Research assistants were assigned to the five districts 
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with larv:ost Title 1 populations to assist in the evaluation effort 

How these reports, normally published by September , were clelayed unLil 
Marc^h' follows. Each main reason as detailed. 

1. ' Lack of typing service: Secretaries who normally 'would be 

typing final reports for other projects were I'Md off. Re- 
maining secretarial staff (one secretary) was left to com- 
plete reports from Alternative Programs, Career Education, 
Special Education as well as the district reading reports, 

2. Lay-off of staff members respons le for writing reports; 
Cuts reduced four associates and five assistants, who nor- 
mally are responsible for writing the reports, to two 
associates and four assistants. 

3. Necessity for staff members not familiar with projects to 
complete reports started by laid-off staff members: ORE 
staff with enough seniority to escape lay-offs, but whose 
programs were eliminated, were reassigned to positions in 
funded programs left open Dy ORE staff who were cut. The 
fact that a program was cut did not mean, however, that no 
final report on the program was necessary. This left 
double work for several ORE staff members. 

U, Delay in analysis of data due to cuts in the Division of 

Data Processing: This delay only compounded the situation, 
^^specially when a staff member had to take over a report 
from one pf those staff who was cut. 
S. Lay-off, reorganization and reasBignment of project 
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personnel: As a result of the budget reductions, administra- 
tion of the reading project was reorganized. Reading Managers, 
who were responsible for project administration in each dis- 
trict, were terminated. So too, were all but eight reading 
supervisors (one for each district) and all reading consulting 
and collaborating teachers on dis trict^ budgets . Reading super- 
visors were retained on seniority. In two cases, managers 
"bump_ed back" to supervisors in their districts. In two other 
instances, supervisors remained in their districts when the 
managers were cut. Because operating budget funds were most 
affected by budget reductions, the seven districts with Title 
I eligible schools were assigned additional reading help in 
the form of Title I reading coordinators. These positions 
were filled by six former supervisors and one former manager. 
There were no lack of problems in implementing this new or- 
ganization. Mostly, they involved personnel. Coordinators 
reported to supervisors, but since most of the money coming 
into the districts was Title I, some coordinators looked upon 
themselves as being independent. The fact that supervisors- 
turped ^coordinators took a pay cut^ while reporting to their 
former equals who remained as supervisors* only served to com- 
plicate the situation. In one case, a former manager-turned- 
coordinator was assigned to work in the same district with a 
former manager-turned-supervisor . r 

All of this impacted on ORE in a curious fashion. While 
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research associates ipsre unaffected, four research assistants 
were .each assigned to two districts to provide evaluation 
service. Since they were paid by Title I funds, Title I cb- 
ordinators viewed them as an addition to their staffs (there- 
by increasing their power). This was clearly not th^ case, 
since the assistants wefe employees of ORE regardless of the 
funding source. These problems were eventually worked out, 
but until things were finally set, objectives for the 1977- 

1 

1978 year were late in coming. 

IV. PROVIDING SERVICE BEYOND PESOURCES: THE SMALL PROJECT ASSESSMENT 
SERVICE ^ 

There a^re two clear yet, linfortunately, conflicting trends. First, 
the need for evaluation service of educational prograins continues to grow. 
Second, there is less and less money available for the personnel resources 
necessary to conduct program evaluations in public schools. The School 
District of Philadelphia and its Office of Research and Evaluation are not 
at all unique. 

Problems discussed in this paper are shared nationwide. The extent 
to which an office of research and evaluation can provide service to clients 
beyond existing personnel resources is worth exploring: 

The Small Project Assessment Service (SPAS), initially developed by 
Irvin J. Farber, director of the Priority Operations Evaluation Services 
division of ORE, is an attempt at one such exploration. 
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As a service unit, ORE receives many requests for research and evaluation 
assistance. Since the majority of the resources In the office are comnitted 
to legally reqiiired evaluations/ it is ImpoTssible to respond to all such re-^^ 
quests* 

It was In an attempt to *deal with this problem that the Small Project 
Assessment Service was Initiated. This service was designed to assist 
directors of small projects ^vh±ch do not have sufficient funding to provide e 
valuation resources) to assess their cJwn projects so that they cojild get some 
sense of degree of movement toward their objectives. This service made avail- 
able to project directors the technical expertise of ORE personnel to help 
them In their assessment efforts and provide an end-of-year ORE program re- 
view for the purpose of certifying what occurred. 

Basically, the Small Project Assessment Service Is a four step process: 
S tep 1 - Involves completion of the Project Outline Fotm by the project 
director (coordinator). Once this Is forwarded to ORE, It Is 
reviewed and assigned to a staff member who studies the' project 
description and arranges a meeting with the project director • 
or his designee. 

Step 2 - Involves a meeting at which the "Project Assessment Plan" Is 
completed. At this meeting, a precise plan of action Is out- 
llnec^> The ORE sta'ff member assigned to the project handles 
any necessaiy consultations with other ORE personnel (usually 
members of the Division of Instructional Research and Develop- 
ment) . 
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step 3 - Thp project director or his designee conducts the project 
assessment as outlined in the Project Assessment Plan. 
Results of this assessment are forwarded to the ORE auditor 
such form and at such time as previously agreed. 

Step 4 - is a review of the completed assessment effort by the ORE 
staff member assigned to the project. If the assessment 
has been done properly and as planned, the accuracy of the 
assessment is then certified by ORE. 

SPAS was introduced to school district administrative personnel in 
May, 1975. In the nearly three years since its introduction, it has, quite 
frankJy, been under utilized. Only two projects have taken advantage of 
Small Project Assessment. Both involve large numbers of students in over 
two dozen junior hfgh schools. Neither of the proj.ects have followed the 

r 

complete four-step process. 

While the potential is there, SPAS has not been an overwhelming success 
for twp main reasons. First, project personnel do not take the initiative. 
They expect the ORE staff member (who is doing this over and above regular 
work assignments) to do the entire assessment alone. Second, SPAS data pro- 
cessing requests receive the lowest priority from the Division of Instruc-- 
tional Research end Development Services. SPAS is free, and while ORE's 
intentions have been honorable, projects still "get what they pay for." A 
small project cannot be given the same priority for scoring services as the 
funded evaluations which pay ORE salaries. 
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The Small Project ^sessment Service was not introduced here simply to 
show Its lack of success. Certainly this paper would be long enough without 
any mention of it at all. While It needs some revision in Its present form 
the concept Is h good one, especially In financially troubled times. 

An office of research and evaluation could make an Investment In itself 
by assigning one staff member to SPAS full time, or by saving, some portion 
of Its data analysis staff time for SPAS jobs. 

In times of financial crisis, an office o£ research and evaluation is 
likely to find itself shrinking in size from budget to budget. Such an 
office must cultivate, educate and serve its clients. Small Project Assess- 
ment may be a way to do all three, 

FINAL THOUGHTS 

The School District of Philadelphia's budget problems are not unique 
among large urban school systems. How Its Office of Research and Evaluation 
managed to provide service with decre.ased personnel cpuld set examples for 
other research and evaluation units to f^sllow. The degree to which the Small 
Project Assessment Service Is utilized Is important to document. Ways to 
rals^school districts' collective consciences about the Importance of strong 
research and evaluation of flees must be explored. 
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